< 

in 
in 
in 

co 
in 

CM 



Q. 

UJ 



(19) 



J 



Europaisches Petentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(43) Date of publication: 

30.10.2002 Bulletin 2002/44 

(21) Application number: 02006190.9 

(22) Date of filing: 1 9.03.2002 



llOilllllll 

(11) EP 1 253 555 A2 

EUROPEAN PATENT APPLICATION 

(51) lntCl7: G06T 1/00 



04N$-Ef 
MM 11 



(84) 


Designated Contracting States: 


(72) Inventors: 




AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• Miheak, M. Kivanc 




MC NL PT SETR 


Urbana, Illinois 61801 (US) 




Designated Extension States: 


• Venkatesan, Ramarathnam 




AL LT LV MK RO SI 


Redmond, Washington 98052 (US) 


(30) 


Priority: 24.04.2001 US 843287 


(74) Representative: Grunecker, Kinkeldey, 


(71) 




Stockmair & Schwanhausser Anwaltssozletat 


Applicant: MICROSOFT CORPORATION 


Maximilianstrasse 58 




Redmond, Washington 98052-6399 (US) 


80538 Wttinchen (DE) 



(54) Robust and stealthy video watermarking 

(57) An Implementation of a technology is described 
herein for th e protect) o n of rights in the content of a vi deo 
sequence. This technology further generally relates to 
a technology facilitating embedding Imperceptible, de- 
synchronization-resistant watermarks in video se- 
quence and facilitating detecting such watermarks. 
These watermarks are resistant against unintentional 
and intentional modifications. In particular, the water- 
marks are resistant to de-synchronization. In addition, 
the watermarks are perceptually invisible. The water- 
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marks are hidden in the video so that flicker is minimized 
or eliminated. More specifically, this technology hides a 
watermark (of portions thereof) over one or more re- 
gions of successive frames. Each region has a center 
defined by a hash value. A watermark (of portions there- 
of) is encoded Into the region in a "plateau" manner. The 
mark (of portions thereof) is fully encoded in the frames 
surrounding the region's center, but trail off towards the 
edges of the region . This abstract itself is not intended 
to limitthe scope of this patent. The scope of the present 
invention is pointed out in the appending claims. 
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Description 
TECHNICAL FIELD 

s [0001] This invention generally relates to a technology facilitating the protection of rights in the content of a video 
sequence. This invention further generally relates to a technology facilitating embedding imperceplible, de-synchroni- 
zation-resistant watermarks in video sequence and facilitating detecting such watermarks. 

BACKGROUND 

10 

[0002] A "video sequence" is a series of images that typically capture (or simulate) motion, life, action, movement, 
etc. The video sequences are typically accompanied by audio. Watermarking a video sequence presents a series of 
significant challenges that are greater than those faced when watermarking other "digital goods." 
[0O03] "Digital goods" is a generic label for electronically stored or transmitted content. Examples of digital videos 
'5 include images, audio clips, video, digital film, multimedia, software, and data. 

[0004] A video sequence is a specific type of digital videos It rnsy afso be called a "digital video," "video signal," 
"video bitstream," 'video stream," "streaming video," "video media," "video object," "video," "digital film," "digital movie," 
and the like. The emerging field of "digital film" is a high-quality form of video. 

[0005] Digital videos are often distributed to consumers over private and public networks — such as Intranets and 
20 the Internet. In particular, they may be "broadcast' via streaming video of a live or recorded event, In addition, these 
videos are distributed to consumers via fixed computer readable media, such as a compact disc (CD-ROM), digital 
versatile disc (DVD), soft magnetic tape, soft magnetic diskette, or hard magnetic disk (e.g., a preloaded hard drive). 
[0006] Digital videos may be stored in one or many different formats. Some Df the more common multimedia file 
formats include: MPEG, Video of Windows®, QuickTime™, RealVideo™, Shockwave™, and the like. 
2s [0007] Unfortunately, it is relatively easy for a person to pirate the pristine digital content of a digital video at the 
expense and harm of the content owners. Content owners include the content author, artist, publisher, developer, 
distributor, etc. The content-based industries (e.g., entertainment, music, film, television, etc.) that produce and dis- 
tribute content are plagued by lost revenues due to digital piracy. 

[0008] Modem digital pirates effectively rob content owners of their lawful compensation. Unless technology provides 
3D a mechanism to protect the rights of content owners, the creative community and culture will be impoverished, 

Watermarking 

[0009] Watermarking is one of the most promising techniques tor protecting the content owner's rights of a digital 
35 video. Generally, watermarking is a process of altering the digital video such that its perceptual characteristics are 
preserved. More specifically, a "digital watermark" (or simply "watermark") is a pattern of bits inserted into a digital 
video that may be used to identify the content owners and/or the protected rights. 

[0010] Watermarks are designed to be completely invisible or, more precisely, to be imperceptible to humans and 
statistical analysis toois. Ideally, a watermarked video signal is perceptually identical to the original video signal, 
40 [0011] A watermark embedder (i.e., encoder) embeds a watermark into a digital video It typically uses a secret key 
to embed the watermark. A watermark detector (i.e., decoder) extracts the watermark from the watermarked digital 
video. 

[0012] To detect the watermark, some watermarking techniques require access to the original unmarked digital video 
or to a pristine specimen of the marked digital video. Some, watermarking techniques are "blind." This means that they 

45 do not require access to the original unmarked digital video or to a pristine specimen of the marked digital video. Of 
course, these "blind" watermarking techniques are desirable when the watermark detector is publiciy available. 
[0013] Before detection, a watermarked signal may undergo many possible changes by users and by the distribution 
environment. These changes may include unintentional modifications, such as noise and distortions. Moreover, the 
marked signal is often the subject of malicious attacks particularly aimed at disabling the detection of the watermark, 

so [0014] Ideally, a watermarking technique should embed detectible watermarks that resist modifications and attacks 
as long as they result In signals that are of perceptually the same quality. A watermarking technique that is resistant 
to modifications and attacks may be called "robust." Aspects of such techniques are called "robust" if they encourage 
such resistance. 

[0015] Generally speaking, a watermarking system should be robust enough to handle unintentional noise introduc- 
es tion into the signal (such noise my be introduced by A/D and D/A conversions, compressions/decompressions, data 
corruption during transmission, etc.) 

[0016] Furthermore, a watermarking system should be robust enough and stealthy enough to avoid purposeful and 
malicious detection, alternation, and/or deletion of the watermark. Such attack may use a "shotgun" approach where 
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no specific watermark is known or detected (but is assumed to exist) or may use "sharp-shooter" approach where the 
specific watermark is attacked. 

[0017] Those of ordinary skill in the art are familiar with conventional techniques and technology associated with 
watermarks, watermark embedding, and watermark detecting. In addition, those of ordinary skill in the art are familiar 
s with the typical problems associated with proper watermark detection after a marked signal has undergone changes 
(e.g., unintentional noise and malicious attacks). 

[0018] Herein, such a digital watermark may be simply called a "watermark." Genetically, it may be called an "infor- 
mation pattern of discrete values." 

to Desiderata of Watermarking Technology 

[0019] Watermarking technology has several highly desirable goals (i.e., desiderata) to facilitate protection of cop- 
yrights of video content publishers. Below are listed several of such goals. 

[0020] Perceptual Invisibility. The embedded information should not induce perceptual changes in the video quality 
is of the resulting watermarked signal. The test of perceptual invisibility is often called the "golden eyes and ears" test. 
[0021] Statistical Invisibility. The embedded information should be quantitatively imperceptive for any exhaustive, 
heuristic, or probabilistic attempt to detect or remove the watermark. The complexity of successfully launching such 
attacks should be well beyond the computation power of publicly available computer systems.' Herein, statistical invis- 
ibility is expressly included within perceptual invisibility. 
so [0022] Tamperprodfhess. An attempt to remove the watermark should damage the value of the video well above the 
hearing threshold. 

[0023] Cost. The system should be inexpensive to license and implement on botft programmable and application- 
specific platforms. 

[0024] Non-disclosure of the Original, The watermarking and detection protocols should be such that the process of 
25 proving video content copyright both in-situ and in-court, does not involve usage of the original recording. 

[0025] Enforceability and Flexibility. The watermarking technique should provide strong and undeniable copyright 
proof. Similarly, it should enable a spectrum of protection levels, which correspond to variable video presentation and 
compression standards. 

[0026] Resilience to Common Attacks . Public availability of powerful digital video editing tools imposes that the wa- 
so termarking and detection process ie resilient to attacks spawned from such consoles. 

[0027] Hard-to-Break, A watermark is "hard-to-break" when it is "extremely hard" for an attacker to break the water- 
mark even though the attacker may know watermarking technique. Here, "breaking" refers to successfully modifying 
or removing the watermark. In particular, it should be nearly impossible to break the mark under almost all practical 
situations even if an attacker has a supercomputer. 

35 

Watermark Circumvention 

[0028] In general, there are two common classes cf malevolent attacks: 

4° 1 . De-synchronization of watermark in digital video signals. These attacks alter video signals In such a way to 

make it difficult for the detector to identify the location of the encoded watermark codes. 

2. Removing or altering the watermark. The attacker discovers the location of the watermark and intentionally 
alters the video clip to remove or deteriorate a part of the watermark or its entirety. 

45 Particular Video Watermarking Challenges 

[0029] A video is a series of video "frames," Each frame of the video is an image. Since videos are a series of images, 
one way to watermark a video is to embed a watermark (wholly or partially) in each frame (or a significant number) of 
the video. 

so [Q030] As mentioned earlier, watermarking a video sequence presents a series of significant challenges that are 
greater than those faced when watermarking other "digital goods." Particular examples of these challenges Include 
perceptual invisibility and resistance to de-synchronization attacks. Although watermarking other types of media (e.g., 
images and audio) also faces these challenges, the problems of perceptual invisibility and resistance to de-synchro- 
nization are particularly acute and specifically unique for videos. 

55 

De-Synchronization Attacks 

[0031] The watermark (or portions thereof) may be embedded into each frame of the video, However, the chances 
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of a digital pirate discovering the watermark increases as ihe watermark repetition increases. Embedding the watermark 
(or portions thereof) in each frame is also undesirable because it provides convenient range for the pirate to focus hsr 
efforts. In addition, it provides potentially thousands of bounded targets [i.e., frames) containing thesame hidden data 
(i.e., the watermark). With this much bounded information, a digital pirate has a good chance of determining the wa- 
5 termark. 

[0032] To overcome this problem, watermarks (or portions thereof) may be selectively encoded in individual frames 
or groups of frames within the video. To find the encoded information later, ihe detector typically must be synchronized 
along the temporal axis so that it know where (or when) to look for the watermarks. Digital pirates know this. A de- 
synchronization attack is one of their most watermark-fatal'arrows in their quiver. In addition, de-synching may occur 
to unintentionally particularly when video signal is transmitted. 

[0033] Resisting de-synchronization is a particularly difficult challenge in the video realm. A pirate may, for example, 
do any of the following to de-synch a video: 

» remove frames; 
15 » add new frames (such as commercials); 

» add copied frames (copies of adjacent frames); 
» change frames/sec rate; 
• ■ rearrange frames. 

£t7 [0034] If this de-synch attack splits a series of frames in which the full watermark is encoded, then the watermark 
may go undetected, if this attack manages to remove the isolated frames including the watermarks, then the watermark 
may go undetected. 

Perceptual Invisibility 

25 

[0035] As mentioned above, a watermark should be perceptuaJly invisible (which include statistically invisible) within 
the signal. Achieving perceptual invisibility is a particularly difficult challenge in the video realm. 
[0036] Typically, a series of successive frames have one or more common sections. These common seclions contain 
the same image data. For example, if the camera captiring the video frames is fixed on relatively stationary objects 
30 or people, then the vast majority of each frame will be identical. Typically, if the camera isfixed, the background remains 
identical in each frame. 

[0037] If the watermark (or portions thereof) is not encoded in every frame of the video, then some frames will have 
no portion of the watermark encoded therein. Consequently, there will be a transition between encoded frames and 
non-encoded frames. Typically, perceptible "flicker occurs at that transition. Flicker is the perceptible manifestation of 
35 the transition. This problem is particular to video. 

[0038] Flicker may be visible to the human eye. If not, it may be noticeable by statistical analysis tools. Since water- 
mark encoding introduces "noise" into a frame, the transition from "noisy" to "noiseless" frame produces perceptible 
flicker in the common sections of the frames of that transition. 

[0039] Armed with the knowledge of flickering, a digita pirate can focus her attack on the frames in and around 
# transitions. 

Framework to Thwart Attacks 

[0040] Accordingly, there is a need for a new framework for hiding and detecting watermarks in digital video signals 
45 that is effective against unintentional and intentional modifications. In particular, the framework should be resistant to 
de-synchronization. The framework should possess several attributes that further the desiderata of watermark tech- 
nology, described above. In particular, it should be perceptually invisible; thus, it should minimize or eliminate flicker. 

SUMMARY 

50 

[0041] Described herein is a technology facilitating the protection of rights in the content of a video sequence. This 
technology further generally relates to a technology facilitating embedding imperceptible, de-synchronization-resistant 
■watermarks in video sequence and facilitating detecting such watermarks. 

[0042] One or more implementations, described herein, hide and/or detect stealthy and robust watermarks in digital 
55 video signals. These watermarks are resistant against unintentional and intentional modifications. In particular, the 
watermarks are resistantto de-synchronization. In addition, the watermarks are perceptually invisible. The watermarks 
are hidden in the video so that flicker is minimized or eliminated. 

[0043] More specifically, one or more implementations, described herein, hide a watermark (of portions thereof) over 
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one or more regions of successive frames. Each region has a center defined by a hash value. A watermark (of portions 
thereof) is encoded into the region in a "plateau" manner. The mark (of portions thereof) is fully encoded in the frames 
surrounding the region's center, but trail off towards the edges of the region. 

[0044] This summary itself is not intended to limit the scope of this patent. Moreover, the title of this patent is not 
5 intended to limit the scope of this patent. For a better understanding of the present invention, please see the following 
detailed description and appending claims, taken in conjunction with the accompanying drawings. The scope of the 
present invention is pointed out in the appending cfaims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 

[0045] The same numbers are used throughout the drawings to reference like elements and features. 
[0046] Fig. 1 A illustrates the frames (i.e., images) of a video sequence. 

[0047] Fig. 1 B is a diagram illustrating a "plateau" shape of the watermarking of a sequence region; this illustrates 
an example of a watermarked sequence region in accordance with an implementation of the invention herein. 
15 [0048] Fig. 1C is a diagram illustrating multiple plateau-shaped sequence regions of a video signal; this illustrates 
an example of multiple watermarked sequence regions of a signal which is in accordance with an implementation of 
the invention herein. 

[0049] Fig. 2 is a schematic block diagram showing a video watermarking architecture in accordance with an imple- 
mentation of the invention herein. 
SO [0050] Fig. 3 is a schematic block diagram showing a video watermark embedding system in accordance with an 
implementation of the invention herein. ■ 

[0051] Fig. 4 is a flow diagram showing an illustrative methodological implementation (e.g., video watermark em- 
bedding) of the invention herein. 

[0052] Fig. 5 is a schematic block diagram showing a video watermark detecting system In accordance with an 
25 Implementation of the Invention herein. 

[0053] Fig.6 is aflow diagram showing an illustrative methodological implementation (e.g., video watermark detect- 
ing) of the invention herein. 

[0054] Fig.7 is an exampleof a computing operating environment capable of implementing an implementation (whol- 
ly or partially) of the invention herein. 

30 . 

DETAILED DESCRIPTION 

[005S] in the following description, for purposes of explanation, specific numbers, materials and configurations are 
set forth In order to provide a thorough understanding of the present invention. However, it will be apparent to one 

35 skilled in the art that the present invention may be practiced wilhout the specific exemplary details. In other instances, 
well-known features are omitted or simplified to clarify the description of the exemplary implementations of present 
invention, thereby better explain the present invention. Furthermore, for ease of understanding, certain method steps 
ere delineated as separate steps; however, these separately delineated steps should not be construed as necessarily 
order dependent in their performance. 

40 [0056] The following description sets forth one or more exemplary implementations of Robust and Stealthy Video 
Watermarking that incorporate elements recited in the appended claims. These implementations are described with 
specificity in order to meet statutory written description, enablement, and best-mode requirements. However, the de- 
scription itself is not intended to limit Ihe scope of this patent. 

[0057] The inventors intend these exemplary implementations to be examples. The inventors do not intend these 
4S exemplary implementations to limit the scope of the present invention. Rather, the inventors have contemplated that 
the present invention might also be embodied and implemented in other ways, in conjunction with other present or 
future technologies. 

[0058] An example of an embodiment of Robust and Stealthy Video Watermarking may be referred to as an "exem- 
plary video watermaker." 

50 

incorporation by Reference 

[0059] The following co-pending patent applications are incorporated by reference herein (which are all assigned to 
the Microsoft Corporation): 

55 

• U.S. Patent Application Serial No. 09/390271 , entitled *A Technique for Watermarking an Image and a Resulting 
Watermarked" Image" filed Sept. 7, 1999; 

• U.S. Patent Application Serial No. 09/390272, entitled "A Technique for Detecting a Watermark in aMarked Image" 
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filed on Sept. 7, 1999; 

• U.S. Patent Application Serial No. 09/316,899, entitled "Audio Watermarking with Dual Watermarks" filed on May 

22, 1999; 

• U.S. Patent Application Serial No. 09/614,660, entitled "Improved Stealthy Audio Watermarking" tiled on July 1 2, 
s 2000; 

• U.S. Patent Application Serial No. , entitled "Robust Recognizer of Perceptually Similar Con- 
tent" tiled on April 24, 2001; ~ 

• U.S. Patent Application Serial No. , entitled "Derivation and Quantization of Robust Non-Local 

Characteristics for Blind Watermarking" filed on April 24, 2001 ; 

10 • U.S. Patent Application Serial No. , entitled "Recognizer of Audio-Content in Digital Signals" 

filed on April 24, 2001 ; and 

• U.S. Patent Application Serial No. 09/421 ,986, entitled "System and Method for Hashing Digital Images" filed on 
October 19, 1999. 

is introduction 

[0060] The one or more exemplary implementations, described herein, of the present invention may be implemented 
(whole or in part) by a video watermarking architecture 200 and/or by a computing environment like that shown in Fig. 7. 
[0061] Herein, references to embedding or detecting a watermark expressly includes the embedding or detecting of 
20 a portion of a watermark. Portions of the watermark may, for example, be embedded in a single frame. The collection 
of such frames may constitute the entire watermark. Moreover, refe-ences herein to walermarks expressly include any 
information data patterns, 

[0062] With the exemplary video watermaker, the walermarks are encoded (e.g., embedded) over regions of suc- 
cessive frames. These regions include successive adjacent frames. These regions may also be called "temporal re- 
zs gions" since the frames typically fail into a specif ic time sequence in the video signal. Herein, they may also be called 
"sequence regions" and "neighbor regions." 

[0063] A marked video includes multiple regions. The centers of each are apparently randomly selected. The water- 
mark is encoded into the region in a "plateau" manner. The region is approximately plateau shaped. This means that 
the watermark is fully encoded in the frames surrounding the region's center, but trail off towards the edges of the region. 

30 [0064] Typically, the watermark detection of the exemplary video watermaker approximately locates the center of 
each region. Sincethe watermark is encoded over a region of frames (ratherthan isolated single frames), the watermark 
detection system can find the embedded mark anywhere within the region. This is true even when it fails to locate the 
exact center of the region because of de-synchronization. In context of sequence regions that are approximately plateau 
shaped, they may be called "plateau regions," "watermark plateaus," and the like. 

35 [0D55] Described herein, the exemplary video walermaker has at least two approaches: a "fully blind" and "partially 
blind" approach. 

Hashing 

40 [0066] Generally, hashing techniques are used in many areas such as database management, querying, cryptogra- 
phy, and many other fields involving large amounts of raw data. 

[0067] In general, a hashing technique maps a large block of raw data into relatively small and structured set of 
identifiers. These identifiers are also referred to as "hash values" or simply "hash." By introducing a specific structure 
and order into raw data, the hashing function drastically reduces thesize of the raw data intoshort identifiers. Itsimplifies 
45 many data management issues and reduces the computational resources needed for accessing large databases. 
[0068] Mathematically, a hashing technique includes a hashing function H(). That function takes a signal x as input 
and computes a short vector h = H(x). That vector is an apparently random value in some large set. That vector fi is 
a hash value. 

[0069] Alternatively, the hashing technique may employ a secret key K. This cryptographic hashing technique in- 
50 eludes a hashing function H^( ). That function takes a signal x as Input and computes a short vector h = H^x). That 
vector (i.e., hash value) is an apparently random value in some large set, but it is indexed by a secret key K. 
[0070] A hash value may be thought of as a binary string given a signal (e.g., an image). This string serves as the 
signature of the input signal and is approximately invariant under all acceptable modifications on the input signal (i.e., 
modifications under which the quality of the input image is preserved for all practical purposes). To be more precise, 
55 the hash technique used by the exemplary video watermaker operates on frames. {i.e., Images) of a video signal such 
that; 

• The hash values possess approximate uniform cistribitiort; 
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• The hash values of two perceptually distinct signals (e.g., images) are approximately independent; and 

• The hash values Df two perceptually similar signals (e.g., images) are the same with high probability. 

[0071] Herein, perceptual similarity may be thought of in this manner: If two signals (e.g., images) are perceptually 
simitar, then an observer should be able to say that they are indeed the same signals (e.g., images) for all practical 
purposes, such that a reasonable amount Df perceptual quality is mainlained. Such perceptual qualities also applies 
to statistical analysis of machines as well as humans. 

[D072J In addition, for the purpose of identifying the location of the watermark in a video signal, an intermediate hash 
function serves equally well as a final hash function. See the descriptions in the incorporated pending U.S. Patent 
Applications (in particular, the ones entitled "Robust Recognizer of Perceptually Similar Content" and "Recognizer of 
Audio-Content in Digital Signals") for more details on intermediate and final hashing. 

[0873] When selecting an intermediate hash function, the hash values of perceptually distinct signals are distant 
from each other (in the sense of tf(.,.)} and hash values of perceptually similar signals are close to each other (in the 
sense of d{.,.)). Herein, d(.,.) refers to normalized Hamming distance. 

[0074] Formore information about hashing techniques that may be employed with the exemplary video watermaker, 
see the following pending U .S. Patent Applications (which are incorporated by reference): 

• Serial No. , entitled "Robust Recognizer of Perceptually Similar Content" filed on April 24,2001 ; 

• Serial No. , entitled "Recognizer of Audio-Content in Digital Signals" filed on April 24, 2001 ; and 

• Serial No. 09/421,986, entitled "System and Method for Hashing Digital Images" filed on October 19, 1999. 

Exemplary Video Watermarking Overcomes the Particular Challenges 

[0075] As mentioned earlier, watermarking a video sequence presents a series of significant challenges that are 
greater than those faced when watermarking other digital goods. Particular examples of these challenges include 
perceptual invisibility and resistance to de-synchronization. Although watermarking other types of media (e.g., images 
and audio) also laces these challenges, the problems of perceptual invisibility and resistance to de-synchronization 
are particularly acute and specifically unique for videos. 

De-Synchronization 

[0076] The watermark (or portions thereof) may be embedded into each frame of the video. However, the chances 
of adigital pirate discovering the watermark increases as the watermark repetition increases. Embedding the watermark 
(or portions thereof) in each frame is also undesirable because It provides convenient range for the pirate to focus her 
efforts, in addition, it provides potentially thousands of bounded targets (i.e., frames) containing the same hidden data 
(i.e., the watermark) that the pirate may attack. With these narrow targets, a digital pirate has a good chance of deter- 
mining the watermark. 

[0077] To overcome this problem, the exemplary video watermaker selectively encodes watermarks (or portions 
thereof) into sequence regions within the video. To find the encoded information later, the exemplary video watermaker 
approximately locates the centers of these regions by hashing the video signal. 

[0078] If a de-synch attack removes, adds, or rearranges frames, the center determined by the detection system of 
the exemplary video watermaker offset from the true center of the region. Since the multiple frames within that region 
are encoded with the watermark, the exemplary video watermaker can detect the watermark in a frame offset from the 
center. The de-synch would need to significanlly alter the video signal before the center determined by the detection 
system of the exemplary video watermaker is offset enough to be miss the region entirely. 

Perceptual Invisibility 

[0079] The exemplary video watermaker encodes a watermark that is perceptually invisible within the signal. It min- 
imizes or eliminates flicker caused by watermark encoding. 

[OOSO] The watermark is encoded into the sequence region in a "plateau" manner. This means that the watermark 
is fully encoded in the frames surrounding the region's center, but trail off towards the edges of the region. 
[0081] The trailing edges of the plateau give the region boundaries a softer transition between marked frames and 
unmarked frames. This is significantly less perceptible — statistically and visually— than the "flicker" of traditional video 
watermarking. 
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Plateau-Shaped Sequence Regions 

Video Sequence Example 

s [0032] Fig. 1 A illustrates an example of a series of individual images {i.e., frames) that collectively compose a video 
sequence over time. This example video sequence includes frames 140. These frames are labeled x jt where /= 1 . 
2, n. The numbered order of the frames (1 , 2, n) indicates the typical chronological order of the frames. This 
video sequence may be all of or any portion of a complete video oackage. 

■to Plateau-Shaped Watermarked Region 

[0083] Fig. 1B illustrates a diagram of a plateau-shape of the watermarked sequence region. This illustrates an 
example of a watermarked sequence region in accordance with the exemplary video watermaker. The "plateau-shaped" 
watermark encoding technique of the exemplary video watermaker reduces (or eliminates) the effect of de-synchront- 
*s 2ation and flicker. 

[0034] The frames 140 are Indicated by the same ^labeling as Fig. 1A Dashed horizontal line 142 indicates a 
baseline of a video signal without watermark encoding. Solid line 144 indicates the actual video signal relative to the 
baseline 142. A video signal — such as the one indicated by line 144 — is typically not perfectly smooth, straight, etc. 
For the sake of simplicity, video signal 144 is illustrated in Fig. 1B in an idealized form. 
20 [0085] In accordance with the exemplary video watermaker, an information pattern (such as a watermark or a portion 
thereof) is embedded into the video signal 144. This 'may be accomplished using traditional or new watermarking 
techniques. Image watermarking techniques may be used to embed watermarks into the frames of the video signal. 
[0036] Within a range of frames, the watermark is embedded. That range of frames is called the plateau region 150. 
The plateau region ranges from frame Xj. k io in Fig. 1 B, where /' is the center of the region and 2fa-1 is the length 
of the region. The center frame of the region 150 is frame x s or frame 156. 

[0087] The center frame (e.g., frame 156) is determined by hashing the video signal (or portions thereof). Thus, the 
locations of the centers of each region are determined by the inherent characteristics of the signal itself. 
[0088] Alternatively, when embedding the watermark, the center frame 1 56 might not be the exact frame determined 
by the hashing. Thus, the region may be offsetfrom 1he frame determined by the hashing. This may be called "offset 
so centering" of the region. The degree of the offset may be determined pseu do randomly, mathematically, via hashing, 
and/or it may be fixed. Assuming that the detection system is capah y of reliably detecting the watermarks, this offset 
centering is acceptable and within the scope of the exemplary video watermaker described herein. It is particularly 
acceptable because it adds the robustness of the exemplary video watermaker. 

[0089] Full Mark Zone (FMZ) of the Plateau. The watermark is fully encoded in the frames surrounding the center 
35 frame 156. Theses surrounding frames form a zone called a full mark zone (FMZ) 152. The FMZ 152 ranges from 
frame Xj_ z to Xj +Z in Fig. 1B, where 2z+1 is the length of the zone. In other words, the full mark zone (such as FMZ152) 
includes z frames before the center frame 156 and z frames before the center frame. With reference herein to the 
FMZs and the plateau regions, the terms "fully encoded," "gradient encoding," and "partially encoded" refer to the 
relative intensity (e.g., relative strength otscate)wilh which t : ie mark is encoded. "Fully encoded" is full relative intensity. 
40 [0090] Generally, fully encoding the watermark in the FMZ 152 of the plateau region 150 increases the robustness 
of the watermark encoded by the exemplary video watermaker. Primarily, it reduces (or eliminates) the effect of de- 
synchronization on a video signal (such as signal 144). 

[0091] Edges of the Plateau. The plateau region 150 includes gradient edges 154a and 154b in Fig. 1B. On the 
leading side of the FMZ 152 is leading edge 154a. On the trailing side of the FMZ 152 is trailing edge 154b. Within 
45 these edges the watermark is partially encoded. More precisely, the watermark is gradiently encoded, which is either 
increasingly or decreasingly encoded, 

[0092] For leading edge 154a, the relative intensity with which the mark is encoded increases with successive frames. 
The leading edge 1 54a ranges from frame Xj_ k tc Xj. z in Fig. 1 B, where k - z is the length of this edge. 
[0093] Typically, the trailing edge 154b is the mirror image of leading edge 154a. Fortrailing edge 154b, the relative 
so intensity with which the mark is encoded decreases witn successive frames. The trailing edge 1 54b ranges from frame 
x^tox/^in Fig. 1B, where fc-zis the length of this edge. 

[0094] Alternatively, the values of /rand z on eithersize of the center need not be equivalent. In particular, the value 
o1 k-z may differ for the leading and trailing edges (e.g., edges 154a and 154b). In this situation, the edges are not 
mirror images of each other. However, this would make the "center" of the region be off the true center. Assuming that 
55 the detection system is capably of reliably detecting the watermarks, this type of approximate centering is acceptable 
and within the scope of the exemplary video watermaker described herein. It is particularly acceptable because it adds 
the robustness of the exemplary video watermaker. 

[0095] As introduced in the Background section, a malicious attacker can easily find abrupt changes in the intensify 
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of consecutive video frames. Such abrupt changes are common in traditional video watermarking. These changes 
produce a perceptible flicker effect. 

[0096] The gradient edges (e.g., edges 154a and 154b) of the plateau region 150 give the region's boundaries a 
softer transition between marked frames and unmarked frames. The smooth transition of the gradient edges is signif- 
icantly less perceptible — statistically and visually — than the "flicker" of traditional video watermarking. 
[0097] Generally, gradient encoding the watermark in the FMZ 152 of the plateau region 1 50 increases the robuslness 
of the watermark encoded by the exemplary video watermaker. Primarily, it reduces (or eliminates) the effect of flicker 
on a video signal (such as signal 144). 

[0096] Shape of Plateau Regions. The shape of a plateau region is representative of the relative intensity of the 
watermarking encoding of that region. The shapes of the plateau regions illustrated herein (in particular, in Figs. 1 B 
and 1 C) are only examples. The name "plateau" is intended to be a convenient label that evokes an image of the 
overall general shape of the region. However, the shapes of the plateau regions are not limited to those illustrated 
herein or to the shape of a literal plateau, 

[0099] With respect to the shape of a plateau, it may take nearly any shape. The range of shapes are bounded by 
characteristics described in the tanguage claimed he-ein. Examples of such characteristics of a plateau regions gen- 
erated by the exemplary video watermaker include: 

• one or more frames within the region is fully encoded relative to other frames (in particular; unmarked frames); 

• one or more frames within the region are gradiently encoded relative to thef Lilly encoded frames and the unmarked 
frames. 

[0100] With these characteristics in mind, a plateau region generated by the exemplary video watermaker may be 
described, for example, with the following shape descriptions: bump, convex, gibbous, bulge, lump, hump, bulbous, 
mountain-shaped, peak, mound, mesa, hill, knoli, hillock, butte, drumtin, hummock, dune, tussock, molehill, anthill, 
dome, arch, hemisphere, half-circle, trapezoid, and the like. 

[0101] Watermark Detection with the Plateau Regions. A watermark detection system of the exemplary video wa- 
termaker processes a subject video signal. Typically, before such detection, it is unknown whether such signal includes 
a watermark. Likewise, it is unknown whether the subject signal has been modified from the original signal. Such 
modification may be intentional or unintentional. 

[01 02] Using hashing techniques, the watermark detection system approximately locates the center of each plateau 
region. More precisely, it locates frames that it considers the centers of their regions. These frames are called "detection 
frames" herein. To find the detection frames, the watermark detection system uses the same technique as the embed- 
ding system uses to locate the regions 1 center frames. 

[0103] Typically, the subject video signal itself is hashed to find the detection frames, If the subject signal remains 
unmodified from the original, then Ihe detection system finds the actual center of each region. If the subject signal has 
been modified, then the "centers" found by the detection systems approximate the centers of the regions. 
[0104] However, the watermark detection system need not find the actual center of a region to detect a watermark 
encoded within the region. Since the watermark is encoded in each of the frames of the plateau region, the watermark 
detection system is likely to find the embedded mark anywhere within the region. However, if the approximate center 
determined by the detection system falls within a full mark zone (FMZ), then it is more likely to detect the watermark 
then if the if the approximate center falls within a boundary edge. 

[01 OS] For example, assume that video signal 144 of Fig, 1 B is a subject signal and that it has been de-synchronized 
(intentionally or unintentionally). The actual center of the signal before such de-synchronization was frame 156. How- 
ever, the approximate center — determined by hashing the de-synchronized subject signal — may be frame 1 62, frame 
164, or frame 166. These frames are indicated by dashed-dolted arrows pointing to the encoded signal of the region 
150 of Fig. 1B. 

[01 06] Frame 1 62 is just off-center from the center frame 1 56. Like the center frame and every other frame in the 
FMZ 152, it is fully encoded with the watermark. Consequently, the detection system is highly likely to detect the 
encoded watermark within frame 1 62. 

[0107] Frame 164 is more off-center from the center frame 156 than frame 162, but it is still within the FMZ 152. 

Similarly, the detection system is highly likely to detect the encoded watermark within frame 164. 

[0108] Frame 166 is significantly, off-center from the centerframe 156. So much so, that it falls outside the FMZ 152. 

However, it still is within the plateau region 150. Specifically.-it is within trailing edge 154b. Although the watermark is 

not fully encoded within this edge, it Is still partially encoded in frame 166 of edge 156b. Consequently, there is a 

possibility that the detection system may detect the encoded watermark within frame 1 66. 

[0109] However, since the mark is only partially encoded there is an increased possibility of missing the watermark. 

In this situation, the video has most likely been de-synched sufficiently to produce a modified video that is perceptually 

different from the original video. 
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[01 1 0] Conventional watermark detection encodes the marks in isolated frames. With Fig. 1 B, if the mark was only 
encoded in frame 156, the de-synch attack would cause the conventional watermark detection to miss frame 156 
because it would be looking for the mark in frames 162 or 164. 

Multiple Regions 

[0111] Fig. 1C is a diagram illustrating an example video signal 146 having multiple watermarked plateau regions 
1 50a-150k i n accorda nee with the exemplary video watermaker. The center of the p lateau regio ns 1 50a-1 50 k is def ined 
(i.e., located) by a hash value. Multiple hash values are determined by hashing the signal itseif . 
[01 12] As a consequence of the almost uniform distributed nature of hash values, the plateau regions are distributed 
throughout the signal in an almost uniform and manner that appears random Moreover, as illustrated in Fig. 1C, the 
size and shape of the regions may be varied. 

Partially and Fully Blind Approaches 

[0113] The exemplary video watermaker may be implemented via, at least, two approaches: "Partially Blind" and 
"Fully Blind." Both are broadly shown in Figs. 3-6. 

Partially Blind Approach: 

[0114] In the partially blind approach, the exemplary video watermaker selects multiple frames of the video. These 
selected frames will be the center frames of plateau regions. To select these center frames, the exemplary video 
watermaker may randomly or pseudorandomly select them. The center frames define the center of the plateau region 
for embedding marks. 

[0115] Once the frames are selected, the exemplary video watemnakerhashes those selected frames and stores 
their hash values. These will be called the "center frame hash values" herein. These values identify the locations of 
center frames for watermark embedding. These hash values may use asecret key; thus, may be pseudorandom also. 
[01 1 6] Once these hash values are found, the watermarks are inserted in the plateau regions of the selected center 
frames. The hash values are stored in a data storage. The locations of the center frames are not stored. Rather, the 
hash values of those center frames are stored. 

[0117] The hash values are sent as side information to the watermark detection system For this approach, it is 
assumed that the watermark detection system has secure access to the stored hash values of the center frames. The 
hash values may becryptographlcally transmitted, to the detection system along with or separate from the video signal 
being examined by the system. Regardless, this approach assumes that users (and attackers) do not have access to 
thern, 

[011 B] For example, the hash values may be sent to a software video player on a computer (or to a DVD player) 
secretly and the user does not know what these hash values are. Another example could be cryptographic encryption 
of these hash values via a secret key and transmitting them secretly or spreading them around video data in a secret 
manner such that atteckers would not be able to find thern. 

[01 1 9] At the detector end, the hash valuo of each frame is found and compared to the hash values In the stored list 
of hash values. For the frames whose hash values substantially match an entry in the list, the detector looks for wa- 
termark in that frame. Those frames are called the "detection frames." Alternatively, it tooks for the watermarks in 
frames — whose hash values does the match — surrounding a detection frame. This is done for each detection frame. 
The detection frames effectively "synch" the watermark detection process. 

[0120] The term partially blind comes from the factthat additional information is needed at the detector side, meaning 
it is not completely blind. But it is not non-blind as well. A non-blind watermarking scheme requires the original unmarked 
video to be present at the deteclor end. 

[0121] With this approach, an attacker may determine the locations of Ihe detection frames. To find the detection 
frames, the attacker only needs to determine the hashing function and gain access to the list of hash values (for the 
center frames). 

Fully Blind Approach: 

[0122] The fully blind approach is the same as the partially blind approach, except that there is no list of center frame 
hash values. Thus, the watermark detection system has no list of hash values to compare to the hash of the frames 
of a subject video signal. Instead, the watermark detection system calculates the hash values based upon the subject 
video signal. 

[0123] A comparison between the hash values and randomly generated binary vectors is made in order to decide if 
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the watermark is going to be embedded or not. At the decoder side, the same operation is carried out using the same 
secret key. 

[0124] By using a secret key, the fully blind approach generates asel of random binary sequence a. This might be, 
for example, 1 0 random bits. Then the hash value of each frame within the video sequence is computed, call these fy, 

s where i indexes frame number. 

[0125] As an example, assume lhat these hash values are of length 100. Randomly chosen 10 locations from a 
length 1 00 vector are used and bits from those locations are collected (for each frame independently) to construct the 
"symbol" of that frame (in other words, the "symbol" of each frame is generated from the hash value of that frame by 
random projection, in this particular example the projection ration is 10/100=0.1). Call the symbols Sf, where / Indexes 

to the frames. Once the symbol of each frame is computed, it is compared with the initially randomly found vector (i.e., 
one compares s ; with afor all /. Once there is an exact match, the watermark is embedded around it in a plateau manner. 
{0126] This approach is random in the following aspects; first, vector a is generated randomly; second, each value 
h t is the hash value of frame /, In addition, by the definition Df the hash function, they are also generated randomly, 
then generation of Syfrom h t are also done in a random manner. Secret key Kis used as the seed of the random number 

15 generator in al! these steps. 

[0127] At the detectoi J end : it has access to K. It does the same as above to find the Irame locations. It generates a; 
it generates hash values; and applies random projection, it finds the detection frames, which may or may not be identical 
to the center frames. 

[0128] The same secret key and hash function is used for hashing the center frame for embedding as Is used for 
^0 hashing the detection frames for detecting. Therefore, if the olginal unmarked signal and the subject signal are per- 
ceptually identical, then the hash values of the frames will be identical or nearly so. 

[0129] The unmarked signal and subject signal will be perceptually identical is the subject signal if an unmodified 
version of the marked signal. Furthermore, the unmarked signal and subject signal will be perceptually identical if the 
subject signal is a modified version (e.g., an attacked version) of the marked signal, but such modification did not 

2S perceptually modify the signal. 

[0130] Thus, to determine where the detection frames are located, an attacker must know the secret key and the 
hash function. This approach is particularly appropriate when there is great concern about malicious attacks. 
[0131] In both approaches, the centers of regions around which watermark is going to be embedded are determined. 
This task may be carried out via using robust image hash functions. In partially blind approach, the hash values are 

30 used to determine the locations of the watermarks atthe decoder; thus, partially biind approach istermedto be "partially 
blind". 

[0132] In fully biind approach, a comparison between the hash values and randomly generated binary vectors is 
made in order'to decide if the watermark Is going to be embedded or not. At the decoder side, the same operation is 
carried out using the same secret key: therefore, the fully blind approach is a completely blind approach. 

35 

Exemplary Video Watermarking Architecture 

[01 33] Fig. 2 shows a digital goods production and distribution architecture 200 (e.g., video watermarking architecture 
200) having a content (e.g., video) producer/provider 222 that produces original content and distributes the content 

40 over a network 224 to a client 226. The content producer/provider222 has a content storage 230 to store digital goods 
containing original content. The content producer222 has a watermark embedding system 232 to sign the digital signals 
(e.g., video signals) with a watermark that uniquely identifies the content as original. The watermark embedding system 
232 may be implemented as a standalone process or incorporated into other applications or an operating system. 
[01 34] The watermark embedding system 232 applies the watermark to a digital signal (e.g., video signal) from the 

45 content storage 230. Typically, the watermark identifies the content producer 222, providing a signature that is embed- 
ded in the signal and cannot be cleanly removed. 

[0135] The content produces/provider 222 has a distribution server 234 that distributes the watermarked content 
over the network 224 (e.g., the Internet). A signal with a watermark embedded therein represents to a recipient that 
the signal is being distributed in accordance with the copyright authority of the content producer/provider 222. The 
so server 234 may further compress and/or encrypt the content conventional compression and encryption techniques 
prior to distributing the content over the network 224. 

[0136] Typically, the client 226 is equipped with a processor 240, a memory 242, and one or more content output 
devices 244 (e.g., television, display, sound card, speakers, etc.). The processor 240 runs various tools to process the 
marked signal, such as tools to decompress the signal, decrypt the date, filter the content, and/or apply signal controls 
55 (tone, volume, etc.). The memory 242 stores an operating system 250 (such as a Microsoft® Windows 2000® operating 
system), which executes on the arocessor. The client 226 may be embodied in a many different ways, including a 
computer, a handheld entertainment device, a set-tap box, a television, an appliance, and so forth. 
[0137] The operating system 250 implements a client-side watermark detecting system 252 to detect watermarks in 
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the digital signal and a content loader 254 (e.g., multimedia player, audio player) trj facilitate the use of content through 
the content output devtce(s) 244. if the watermark is present, the client can identify its copyright and other associated 
information. 

[0138] The operating system 250 and/or processor 240 may be configured to enforce certain rules imposed by the 
* content producer/provider (or copyright owner). For Instance, the operating system and/orprocessormay be configured 
tD reject fake or copied content that does not possess a valid watermark. In another example, the system could ioad 
unverified content with a reduced level of fidelity. 

Exemplary Vldso Watermarking Embedding System 

10 

[0139] Fig. 3 shows an exemplary video watermark embedding system 300. which is an example of an embodiment 
of a portion of the video watermarking architecture 200. The watermark embedding system 232 is an example of the 
exemplary video watermark embedding system 300. 

[0140] The watermark embedding system 300 includes a signal obtainer 310, a region locator 320, a region definer 
is 330, and a region marker 340. 

[0141] The signal obtainer310 obtains an unmarked video signal 305 . It may obtainthesignalfrom nearly any source, 
such as a storage device or over a network communications link. 

[0142] The region locator 320 determines the locations of the regions within the signal 305. To determine the region 
locations, the system may first determine the center frame (such as frame 156 of Fig. 1B) of each region. It may 
20 determine the center frames pseudorandomly. After that, it finds the hash value of the center frames. These hash 
values effectively identify the locations of the center frames. Thus, the locations of the centers of each region are 
determined (via the their hash values) by the inherent characteristics of the signal itself. Alternatively, the centerf rarne 
of a region may be offset from the initial frame determined by the region locator 320. 

[0143] The region definer330 defines the parameters of the regions. Such parameters include region length [2ta-1 ) 
55 and FMZ length (2zr-1). These parameters may fixed for ali regions of all signals. They may be fixed for afl regions, 

but varied per signals. They may be varied for all regions of afl signals. Generally speaking, the parameters may be 

manipulated to adjust severai factors including watermark detection probability and robustness. 

[0144] The region marker 340 watermarks the regions of the signal in a plateau manner. The frames of the FMZ are 

fully encoded while theframes of the boundary edges are gradienlly encoded. The region marker may employ traditional 
so or new watermarking techniques particularly those designedfor image watermarking. It may employ spread-spectrum, 

CUM, or other watermarking techniques. This marked video may be publicly distributed to consumers and clients. 

[0145] The functions of aforementioned components of the exemplary video watermark embedding system 300 of 

Fig. 3 are explained In more detail above and below. 

35 Methodological implementation of the Exemplary Video Watermark Embedder 

[0146] Fig. 4 shows the methodological implementation of the exemplary video watermark embedding system 300 
(or some portion thereof). Wore specifically, this figure shows the methodological implementation of watermark em- 
bedding of the exemplary video watermaker. This methodological implementation maybe performed in software, hard- 

40 ware, or a combination thereof. 

[0147] At 410 of Fig. 4, the exemplary video watermaker obtains a video signal. Specifically, this signal is unmarked. 
At 412, it determines the locations of the plateau regions within the signal. The region locations are determined by 
pseudorandomly selecting them (using a secret key). The hash values of selected frame is taken and stored. These 
values are slored. For the partially blind approach, these values are available to the decoding system. For example, 

45 they may accompany the signal in a cryptographic envelope or they come via a separate and secure mechanism. 
[014B] At 414, the exemplary video watermaker defines the parameters of the regions. At 416, it watermarks (he 
regions of the signal in a plateau manner. At 418, the process ends. 

Exemplary Video Watermarking Detecting System 

so 

[0149] Fig. 5 shows an exemplary video watermark detecting system 500, which Is an example of an embodiment 
of a portion of the video watermarking architecture 200. The watermark detecting system 252 is an example of the 
exemplary video watermark embedding system 500. 

[0150] The watermark detecting system 500 includes a signal obtainer 510, a frame locator 520, and a watermark 
ss detector 530. 

[0151] The signal obtainer 51 0 obtains a subject video signal 505. It may obtain the signal from nearly any source, 
such as a storage device or over a network communications link. Typically, it is unknown whether the subject video 
signal 505 is marked and whether it has been modified. 
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[Of 52] The frame locator 520 determines the locations of the "detection frames" of the subject signal 505. The de- 
tection frames are the selected frames of the signal thatthe system will attempt to detect the watermark. The system 
may also attempt to locate the watermark in frames surrounding the selected detection frames. 
[0153] For the both the partially and fully blind approaches, the frame locator 520 uses the same hashing technique 
s (including the same secret key) to find the hash values of frames ol the subject signal as the watermark embedding 
system 300 (specifically, the region locator 320) used for the center frame or a region. 

[0154] For the partially blind approach, the frame !ocalor520compares the just calculated hash values of each frame 
of the subject video to the stored list of hash values (which was originally generated by the watermark embedding 
system 300). Each exact or substantial match is designated a "detection frame." 
to [0155] Forthe fully blind approach, the frame locator 520 selects the detects frames by doing a comparison between 
the hash values and randomly generated binary vectors is made in order to decide if the watermark is going to be 
embedded or not. 

[0156] The watermark detector 530 determines whether watermarks exist in the detection frames. The watermark 
detector employs the detection technique that corresponds the watermarking technique employed by the watermark 
is embedding system 300. The watermark detector 530 indicates whether the watermark is present. 

[01 57] The functions of aforementioned components of the exemplary video watermark detecting system 500 of Fig. 
5 are explained in more detail above and below. 

Methodological Implementation of the Exemplary Video Watermark Detection 

20 

[0158] Fig. 6 show methodological implementation of the exemplary video watermark detecting system 500 (or some 
portion thereof). More specifically, this figure shows the methodological implementation of watermark detecting of the 
exemplary video watermaker. This methodological implementation may be performed in software, hardware, or a com- 
bination thereof. 

25 [0159] At 810 of Fig, 5, the exemplary video watermaker obtains a subject video signal. Typically, it is unknown 
whether the subject video signal 505 is marked and whether it has been modified. 
At 612, it determines the locations of the "detection framesr 1 of the subject signal. 

At 614, the exemplary video watermaker determines whetherwatermarks exist in the detection frames, The watermark 
detector employs the detection technique that corresponds the watermarking technique employed by the watermark 
so embedding methodological implementation of Fig. 4. Typically, it also indicates whether the watermark is present. Such 
indication may be stored, displayed, printed, etc. The process ends at S16. 



Other Implementation Details 

35 [0160] The "partially blind" approach is partially blind in the sense that it requires the hash values to be known at the 
decoder side. The "fully blind" approach is completely blind and relies on the fact that the collision probability of the 
, hash values should be low and approximate uniform distribution should be achieved. 

' [0161] Given the input video {Xy} of length N, the exemplary video watermaker embeds watermarks {wy}, lS/£M,each 
of length L w at M different places. The secret key K\s the seed of the pseudorandom number generator in all the 
4Q randomized tasks in both approaches. Let H{.) denote the hash function to be used that produces a hash of length L. 
Let a(k) denote the k-Xh element of an input vector a. Let fbe a continuous monotonic even function defined on real 
numbers such that f[0)=1 , fT,x) = 0 for IaI > 1 and f(lxl) > f(\x\ + lei), x,e e K. Let {Y f } be an input to the watermark decoder. 



AS 
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Partially Blind Approach 
Watermark Encoding : 



[0162] Pseudorandomly pick the flames ^.^....X^to be the center of the watermark regions, where ;j E{1,2,...IV}, 
Mj<M and l/y-y > Kfor all j* k, 1 < j,k<M. Here K £2+ may be a user-selected parameter. Assume w.l.o.g. that 
so ^<i z <„.<i M . 

[0163] Find H{X,p <,j<, M. 

[0164] Find the semi-global statistics and their quantized values, after watermark embedding for 1 <j<M. 
[0165] Compute sign vectors s (> for 1 <./< Msuch that s,-.(fc) = 1 if p^fc) > \x t fk) and 0 otherwise. 
[0166] Pseudorandomly find the watermarking neighborhood widths {W$ such that W fj £ 2+ , 1 < j< Mand further- 
more W fj + Wfa < /(for 1 <j< /W-1 Is satisfied. 

[0167] Forframe X,-^., embed the watermark W/ using quantization index modulation (QIM) watermarking and em- 
ploying Ay ({kjW^ as the quantizer step size and s^. as the sign vector where 1 < / M, -Wj. <kj< Wj. and {Ay) are user 
entered positive parameters. 
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Watermark Decoding: 

[01 68] Given the input video { Y,] of length W v , compute hash values H(Y,) for all /". 
[01 69] Find frames 



*o foralM </< W such that 



d (ff (ttv) ,h < d (jar (Y fc ) ,ir (x*.)) x < k < N 

for all ~ ~ . 



[0170] For each frame Y, ^ - o^W/,. <, kj <, ctjW f 1 < j< M, carry out watermark decoding using quantization index 
modulation (QIW) watermarking and employing Aftk/W^ as the quantizer step size. Here 0 < otj < 1 are user determined 
parameters. Let the decoded vectors be {w Difc p. ' 
20 [0171] Given {w Dfc/ }, find {w DJ ) using the majority rule: w D/ (J) = 1 if 



and 0 otherwise. Here round(.) denotes rounding to integer operation and w DJ is the resulting decoded vector that is 
derived from the neighborhood of Y^ 

[0172] Declare that the watermark is present if max, cffw DjV iv,) < 7; not present otherwise. 
Fully Blind Approach 
Watermark Encoding : 

35 [0173] Generate M random binary vectors hy, 1 < j< Mo\ length £ where L « L. 
[0174] Find MX/), 1 < /< N . 

[0175] Findtr, 1 < r'<N of length! such that h*(/c) is the l k -th element of H(X,) fori <k<£ and {l 1 ,I 2 ,..Ji) is a 
random subset of {1,2 £.}. ' 

[0176] For each j, 1 < j< M, find frames Xy t such that h. = hy, 1 < fc< JVyfor each j, 1 </< M. Here N/ is the number 
40 of the places where the random binary vector hy matches the hash values of the input video. 

[0177] For each X^, compute the semi-giobal statistics, their quantized values and the corresponding sign vectors; 

randomly find the watermarking neighborhood widths such that there is no overlap between different neighborhoods 

(similar to portions of the encoding part of partially blind approach). Let Sy fc be the sign vector for Xy ft and Wj be the 

watermarking neighborhood width for Xy t (same for all frfor a particular j). 
45 [0178] For frame Xy^/., embed the watermark Wy by using the corresponding sign vector s jk and the quantization step 

size Afll/Wj), -Wy < /y < Wy, 1 <k< Nj for each /', 1 <j<M. Use QIM watermarking for watermark embedding. Here 

quantizer step sizes {Ay] are user entered positive parameters. 



Watermark Decoding : 



[0179] Given the input video {Y,} of length N Y , compute hash values H(V}) for all /. 

[0180] Find h v , 1 < i < A/ y of iength£ such that h v (k) is the / k -th element of H[Y,) for 1 <, k £ I and {/ 1 ,/ 2 ,..., if) is . 
the same subset of {1 ,2 L) found in above in encoding. 

[0181] For each / 1 £/< M, find frames Y A such that hy = hy,1 <h <Nj, 1 <; <M HereiV,- is the number of the places 
where She random binary vector matches the hash vatues of the Input video. 

[0182] For each frame Y^ ;/ -aylVy < \ } < ajWj, 1 <fc <N } , 1 <j<M, carry out watermark decoding using QIM water- 
marking and employing Ay ((1/Wj) as the quantizer step size. Here 0 < ctj < 1 are user determined parameters. Let the 
decoded vectors be 
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[0163] Given 



find {w a j} using the majority rule: w Di/ {m) = 1 if 

15 

zo and 0 Otherwise. Here round(.) denotes rounding to integer operation and w^- is the resulting decoded vector that is 
derived from the neighborhood of Y A over ail possible 

i«{iA....#*} 



[01 84] Declare that the watermark is present if maxjdfw D<fj Wy) < T ; not present otherwise. 

30 Decreasing Visual Artifacts 

[01 85] In both approaches, for a given centerframe, the watermark are embedded in a neighborhood around it. This 
may be done using QIM watermarking. During this process, the sign vectors, that are derived from the center frame, 
may play a role in terms of decreasing visual artifacts. For a particular statistic, if one quantizes to a higher value for 
35 a given frame and if one quantizes to a lower value for a neighboring frame, there will be a slight "flickering effect." in 
order to minimize this effect, a fixed sign vector may be employed. That vector is used for the whole range of neigh- 
borhood. 

Exemplary Computing System and Environment 

40 

[0186] Fig. 7 illustrates an example of a suitable computing environment 900 within which an exemplary video wa- 
termaker, as described herein, maybe implemented (either fully or partially). The computing environment 900 may be 
utilized in the computer and network architectures described herein. 

[01 87] The exemplary computing environment 900 is only one example of a computing environment and is not in- 
45 tended to suggest any limitation as to the scope of use or functionality of the computer and network architectures. 
Neither should the computing environment 900 be interpreted as having any dependency or requirement relating to 
any one or combination of components illustrated in the exemplary computing environment 900. 
[01 88] The exemplary video watermaker may be implemented with numerous other general purpose or special pur- 
pose computing system environments or configurations. Examples of well known computing systems, environments, 
5Q and/or configurations that may be suitable for use include, but are not limited to, personal computers, server computers, 
thin clients, thick clients, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set 
top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed com- 
puting environments that include any of the above systems or devices, and the like. 

[0189] The exemplary video watermaker nay be described in the general context o1 computer-executable instruc- 
ts tions, such as program modules, being executed by a computer. Generally, program modules include routines, pro- 
grams, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data 
types. The exemplary video watermaker may also be practiced in distributed computing environments where tasks are 
performed by remote processing devices that are linked through a communications network. In a distributed computing 
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environment, program modules may be located in both local and remote computer storage media including memory 
storage devices. 

[01 90] The computing environment 900 includes a general-purpose computing device in the form of a computer 902. 
The components of computer 902 can include, by are not limited to, one or more processors or processing units 904, 
s a system memory 906, and a system bus 908 that couples various system components including the processor 904 
to the system memory 906. 

[0191] The system bus 908 represents one or more of any of several types of bus structures, including a memory 
bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a 
variety of bus architectures. By way of example, such architectures can include an Industry Standard Architecture (ISA) 
10 bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association 
(VESA) local bus, and a Peripheral Component Interconnects (PCI) bus also known as a Mezzanine bus. 
[0192] Computer 902 typically includes a variety of computer readable media. Such media can be any available 
media that is accessible by computer 902 and includes both volatile and non-volatile media, removable and non- 
removable media. 

is [oi 93] The system memory 906 includes computer readable media in the form. of volatile memory, such as random 
access memory (RAM) 910, and/or non-volatile memory, such as read only memory (ROM) 912. A basic input/output 
system (BIOS) 914, containing the basic routines that help to transfer information between elements within computer 
902, such as during start-up, is stored in ROM 912. RAM 910 typically contains data and/or program modules that are 
immediately accessible to and/or presently operated on by the processing unit 904. 

20 [0194] Computer 902. may also include other removable/non-removable, volatile/non-voiatile computer storage me- 
dia. By way of example, Fig. 7 illustrates a hard disk drive 91 6 for reading from and writing to a non-removable, non- 
volatile magnetic media (not shown), amagnetic disk drive 918forreadingfrom and writing to a removable, non-voiatile 
magnetic disk 920 (e.g., a "floppy disk"), and an optical disk drive 922 for reading from and/or writing to a removable, 
non-volatile optical disk 924 such as a CD-ROM, DVD-ROM, or other optical media. The bard disk drive 91 6, magnetic 

25 disk drive 918, and optical disk drive 922 are each connected to the system bus 908 by one or more data media 
interfaces 928. Alternatively, the hard disk drive 91 6, magnetic disk drive 91 8, and optical disk drive 922 can be con- 
nected to the system bus 908 by one or more interfaces (not shown). 

[0195] The disk drives and their associated computer-readable mediaprcvide non-voiatile storage of computer read- 
able instructions, data structures, program modules, and other data for computer 902. Although the example illustrates 

so a hard disk 916, a removable magnetic disk 920, and a removable optical disk 924, it is to be appreciated that other 
types of computer readable media which can store data that is accessible by a computer, such as magnetic cassettes 
or other magnetic storage devices, flash memory cards, CD-ROM, digital versatile disks (DVD).or other optical storage, 
random access memories (RAM), read only memories (ROM), electrically erasable programmable read-only memory 
(EEPROM), and the like, can also be utilized to implement the exemplary computing system and environment. 

3S [0196] Any number of program modules can be stored on Uie hard disk 916, magnetic disk 920, optical disk 924, 
ROM 912, and/or RAM 91 0, including by way of example, an operating system 926, one or more application programs 
928, other program modules 930, and program data 932. Each of such operating system 926, one or more application 
programs 928, other program modules 9G0, and program data 932 (or some combination thereof) may include an 
embodiment of a signal obtainer, a region locator, a region definer, a region marker, a signal marker, a frame locator, 

40 a synchronizer, and a watermark detector. 

[0197] A usor can enter commands and information into computer 902 via input devices euch as a keyboard 934 
and a pointing device 936 (e.g., a "mouse"). Other input devices 938 (notshown specifically) may include a microphone, 
joystick, game pad, satellite dish, serial port, scanner, and/orthe like. These and other input devices are connected to 
the processing unit 904 via input/output interfaces 940 that are coupled to the system bus 908, but may be connected 

45 by other interface and bus structures, such as a parallel port, gama port, or a universal serial bus (USB). 

[0198] A monitor 942 or other type of display device can also be connected to the system bus 908 via an interface, 
such as a video adapter 944. In addition to the monitor 942, other output peripheral devices can include components 
such as speakers (notshown) and a printer946 which can be connected to computer902 via the input/output Interfaces 
940. 

so [0199] Computer 902 can operate in a networked environment using logical connections to one or more remote 
computers, such as a remote computing device 948. By way of example, the remote computing device 948 can be a 
personal computer, portable computer, a server, a router, a network computer, a peer device or other common network 
node, and the like. The remote computing device 948 is illustrated as a portable computer that can include many or 
all of the elements and features described herein relative to computer 902, 

55 [0200] Logical connections between computer 902 and the remote computer948 are depicted as a local area network 
(LAN) 950 and a general wide area network (WAN) 952. Such networking environments are commonplace in offices, 
enterprise-wide computer networks, intranets, and the Internet. 

[0201 ] When implemented in a LAN networking environment, the computer 902 is connected to a local network 950 
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via a network interface or adapter 954. When implemented in a WAN networking environment, the computer 902 
typically includes a modem 956 or other means for establishing communications over the wide network 952. The 
modem 956, which can be internal or external to computer 902, can be connected to the system bus 908 via the input/ 
output interfaces 940 or other appropriate mechanisms. It is to be appreciated that the illustrated network connections 
s are exemplary and that other means oT establishing communication llnk(s) between the computers 902 and 948 can 
be employed. 

[0202] In a networked environment, such as that illustrated with computing environment 900, program modules de- 
picted relative to the computer 902, or portions thereof, may be stored in a remote memory storage device. By way of 
example, remote application programs 958 reside on a memory device of remote computer 948. For purposes' of 
10 illustration, application programs and other executable prog-Em components such as the operating system are illus- 
trated herein as discrete blocks, although it is recognized that such programs and components reside at various times 
in different storage components of the computing device 902, and are executed by the data processors) of the com- 
puter. 

15 Computer- Executable Instructions 

[0203] An implementation of an exemplary video watermakermay be described in the general context of computer- 
executable instructions, such as program modules, executed by one or more computers or other devices. Generally, 
program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks 
20 or implement particular abstract data types Typically, the functionality of the program modules may be combined or 
distributed as desired in various embodiments. 

Exemplary Operating Environment 

25 [0204] Fig. 7 illustrates an example of a suitable operating environment 900 in which an exemplary video watermaker 
may be implemented. Specifically, the exemplary video watermaker(s) described herein may be implemented (wholly 
or in part) by any program modules 928-930 and/or operating system 926 in Fig. 7 era portion thereof. 
[0205] The operating environment is only an example of a suitable operating environment and is not intended to 
suggest any limitation as to the scope or use of functionality of the exemplary video watermaker(s) described herein. 

30 Other well known computing systems, environments, and/or configurations that are suitable for use include, but are 
not limited to, personal computers (PCs), server computers, hand-held or laptop devices, multiprocessor systems, 
microprocessor-based systems, programmable consumer electronics, wireless phones and equipments, general- and 
special-purpose appliances, application-specific integrated circuits (ASICs), network-PCs, minicomputers, mainframe 
computers, distributed computing environments that include any of the above systems or devices, and the like. 

35 

Computer Readable Media 

[0206] An implementation of an exemplary video watermaker may be stored on or transmitted across some form of 
computer readable media. Computer readable media can be any available media that can be accessed by a computer. 
4o By way of example, and not limitation, computer readable media may comprise "computer storage media" and "com- 
munications media." 

[0207] "Computer storage media" include volatile and non-volatile, removable and non-removable media implement- 
ed in any method or technology for storage of information such as computer readable instructions, data structures, 
program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash 
*s memory or olher memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cas- 
settes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be 
used to store the desired information and which can be accessed by a computer. 

[0208] "Communication media'" typically embodies computer rsadable instructions, data structures, program mod- 
ules, or other data in a modulated data signal, such as carter wave or other transport mechanism. Communication 

so media also includes any information delivery media. 

[0209] The term "modulated data signal" means a signal Ihat has one or more of its characteristics set or changed 
in such a manner as to encode information in the signal. By way of example, and not limitation, communication media 
includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, 
infrared, and other wireless media. Combinations of any of the above are also included within the scope of computer 

55 readable media. 
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Conclusion 

[D210] Although the invention has been described in language specific to structural features and/or methodological 
steps, It is to be understood that the invention defined in the appended claims is not necessarily limited to the specific 
s features or steps described. Rather, the specific features and steps are disclosed as preferred forms of implementing 
the invention. 
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Claims 

1 . A method for facilitating the insertion of information into a video signal, the method comprising: 

embedding an information pattern in one or more regions of the video signal, a region comprising a plurality 
successive frames; 

wherein, for-oneormore regions, the information pattern is embedded into a frame of a region with a relative 
degree of intensity and re | al h, e | orte on e one or more frames of that region have the patterns embedded therein which 
have a relative intensity r=lative | that differs from the relative intensity of the pattern embedded in other frames of 
the region. 

2. A method as recited in claim 1 for facilitating the protection of a video signal, wherein the information pattern is a 
watermark. 

3. A method as recited in claim 1 further comprising locating the oneor more regions of the video signal for embedding 
2s an information pattern therein. 

4. A method as recited in claim "I further comprising randomly locating the one or more regions of the video signal 
for embedding an information pattern therein. 

so 5. A method as recited in claim 1 further comprising locating the one or more regions of the video signal by randomly 
selecting frames of the signal, where each of the regions includes at least one of the selected frames. 

6. A method as recited in claim 1 further comprising specifying the dimensions of the one or more regions of the 
video signal. 

35 

7. A method as recited in claim 1 further comprising determining hash values of one or more frames of one or more 
of the regions of the video signal. 



40 



8. A method as recited in claim 1 further comprising: 

determining hash values of one or more frames of one or more of the regions of the video signal; 
persisting the hash values with an association with the video signal. 

9. A method as recited in claim 1 .wherein, for one or more regions, the information pattern is embedded into a frame 
45 of a region in a plateau-shaped manner. 

10. A method as recited in claim 1 , wherein, for one or more regions, the relative intensity of information pattern 
embedded into a group of successive frames of the plurality of a region is substantially identical. 

so 11. A method as recited in claim 1 , wherein, for one or more regions, the relative intensity of information pattern 
embedded into a group of successive frames of the plurality of a region is approximately similar. 

12. A method as recited In claim 1, wherein, for one or more regions, the relative intensity of information pattern 
embedded into a group of successive frames of the; plurality of a region is gradient. 



55 



13. A modulated video signal generated in accordance with a method as recited in claim 1. 

14. A computer-readable medium having computer-execu:able instructions that, when executed by a computer, per- 
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forms a method as recited in claim 1. 

15. A computer comprising one ormore computer-readable media having computer-executable instructions that, when 
executed by the computer, perform a method as recited in claim 1 . 

s 

16. A melhod for facilitating the protection of a video signal, the method comprising: 

locating one or more watermark regions of a video signal for embedding a watermark therein, a region com- 
prising a plurality successive frames; 
10 forone Dr more watermark regions, embedding a watermark in a watermark region in an approximate plateau- 

shaped manner. 

17. A method as recited in claim 16, wherein the watermark is embedded into a frame of the region with a relative 
degree of intensity and relativelone or more frames of that region have a watermark embedded therein which has 

is a relative intensity retaS | vel that differs from the relative intensity of the watermark embedded in other frames of that 

region. 

18. A method as recited in claim 16, wherein the locating comprises randomly locating the one ormore regions, 

sa 19. A method as recited in claim 1 6, wherein the locating comprises randomly locating the one or more regions by. 
randomly selecting frames of the signal, where each of the regions includes at least one of the selected frames. 

20. A method as recited in claim 16 further comprising specifying the dimensions of the one or more regions of the 
video signal. 

25 

21. A method as recited in claim 16 further comprising determining hash values of one or more frames of one ormore 
of the regions of the video signal. 

22. A method as recited in claim 16 further comprising: 

so 

determining hash values of one or more frames of one or rno-e of the regions of the video signal; 
persisting the hash values with an association with the video signal. 

23. A method as recited in claim 16, wherein, for one or more regions, the information pattern is embedded into a 
35 frame of a region in a plateau-shaped manner. 

24. A method as recited in claim 16, wherein, for one or more regions, the relative intensity of Information pattern 
embedded into a group of successive frames of the plurality of a region is substantially identical 

no 25. A method as recited in claim 16, wherein, for one or more regions, the relative intensity of information pattern 
embedded into a group of successive frames of the plurality of a region of a region is approximately similar, 

26. A method as recited in claim 16, wherein, for one or more regions, the relative intensity of information pattern 
embedded into a group of successive frames of the plurality of a region is gradient. 

45 

27. A modulated video signal generated in accordance with a method as recited in claim 1 6. 

28. A computer-readable medium having computer-executable instructions that : when executed by a computer, per- 
forms a method as recited in claim 16. 

50 

29. A computer comprising one or more computer-readable media having computer-executable instructions that, when 
executed by the computer, perform a method as recited in claim 1 6. 

30. A method for facilitating the protection of a video signal, the method comprising: 

55 

fully encoding one or more frames of a region of a video signal with a watermark, wherein such frames are 
fully encoded with the watermark relative to unms r-.-.d frames; 

partially encoding one or more frames of the reg^r. with the watermark, wherein such frames are partially 
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encoded with the watermark relative to the frames of the fully encoding. 

31. A modulated video signal generated in accordance with a method as recited in claim 30. 

s 32. A computer-readable medium having computer^executable instructions that, when executed by a computer, per- 
forms a rneihod as recited in claim 30. 

33. A computer comprising one or more computer-readable media having computer-executable instructions that, when 
executed by the computer, perform a method as recited in claim 30. 

10 

34. A method for facilitating the protection of a video signal, the method comprising: 

fully encoding one or more frames of a region of a video signal with a watermark, wherein the frames are fully 
encoded with the watermark relative to unmarked frames; 
15 gradiently encoding at least one plurality of successive frames of the region with the watermark, wherein the 

plurality is gradiently encoded with the watermark relative to the unmarked frames and the fully encoded frames 
of the fully encoding 

35. A modulated video signal generated in accordance with a method as recited in claim 34. 

20 

36. A computer-readable medium having computer-executable instructions that, when executed by a computer, per- 
forms a method as recited in claim 34. 

37. A computer comprising one or more computer-readable media having computer-executable instructions that, when 
23 executed by the computer, perform a method as recited In daim 34. 

38. A method for facilitating the protection of a video signal, the method comprising: 

generating one or more frames of a subject video signal to produce a representative identification ("rep_id") 
so for such frames, wherein a repjd of a frame is based upon inherent characteristics of such frame; 

comparing the representative identification for the frames to a set of one or more expected repjds; 
selecting one or more detection frames of the subject video signal, wherein the generated repjd of a detection 
frame substantially correspond to the an expected repjd of the set. 

35 39. A method as recited in claim 38 further comprising: 

examining the one or more detection frames; 

determining whether a watermark is present based upon such examining and without access to a known 
pristine specimen of the video signal. 

40 

40. A method as recited in claim 38 further comprising: 

examining the one or more detection frames; 

determining whether a watermark is present based upon such examining. 

45 

41. A method as recited in claim 38 further comprising: 

examining the one or more detection frames and frames surrounding one or more detection frames; 
determining whether a watermark is present based upon such examining. 

50 

42. A method as recited in claim 38, wherein the repjd of a frame comprise a hash value ot the frames. 

43. A method as recited in claim 38, wherein the set of one or more expected repjds comprise a hash value of frame 
of an original signal within which a watermark is embedded. 

44. A computer- readable medium having computer-executable instructions that, when executed by a computer, per- 
forms a method as recited in claim 38. 
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45. A computer comprising one or more computer- readable media having computer-executable instructions that, when 
executed by the computer, perform a method as recited in claim 38. 

46. An information pattern encoding system, the system comprising: 

a video signal obtalner configured to obtain a video signal; 

a region locator configured to locate one Dr more regions of the video signal, a region comprising a plurality 
successive frames; 

a region marker configured to embed an information pattern in one or more regions of the video signal, a 
region comprising a plurality successive frames, 

wherein, for one or more regions, the information pattern is embedded into a frame of a region with a relative 
degree of intensity and ,eiaiiveion3 one or more frames of that region have the patterns embedded therein which 
have a relative intensity rE[at | Ve[ that differs from the relative intensity of the pattern embedded in other frames of 
the region. 

47. A system as recited in claim 46, wherein the information pattern is a watermark. 

48. A watermark detecting system, the system comprising: 

a video signal obtainer configured to obtain a subject video signal; 
a frame iocalor configured to: 

• generate one or more frames of the subject video signal to produce a representative identification 
("rep_id") for such frames, wherein a repjd of a frame is based upon inherent characteristics of such 
frame; 

• compare the representative identification forthe frames to a set of one or more expected rep_ids; 

• select one or more detection frames of the subject video signal, wherein the generated repjd of a detection 
frame substantially correspond to the an expected repjd of the set; 

a watermark detector configured to: 

• examine the one or more detection frames; 

• determine whether a watermark is present based upon such examining and without access to a known 
pristine specimen of the video signal. 
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(54) Robust and stealthy video watermarking 

(57) An implementation of atechnology isdescribed 
herein forlheprotection of rights in thecontent of a video 
sequence. This technology lurlher generally relates to 
a technology facilitating embedding imperceptible, de- 
synchronization-resistant watermarks in video se- 
quence and facilitating detecting such watermarks. 
These watermarks are resistant against unintentional 
and intentional modifications. In particular, the water- 
marks are resistant to de-synchronization. In addition, 
the watermarks are perceptually invisible. The water- 



marks are hidden in the video so that flicker is minimized 
or eliminated. More specifically, this technology hides a 
watermark (of portions thereof) over rjne or more re- 
gions of successive frames. Each region has a center 
defined by a hash value. A watermark (of portions there- 
of) is encoded into the region in a "plateau" manner. The 
mark (of portions thereof) is fully encoded in the frames 
surrounding the region's center, but trail off towards 1he 
edges of the region. This abstract itself is not intended 
to limit thescope of this patent. Thescopeof the present 
invention is pointed out in the appending claims. 
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